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Abstract 

High-dimensional computational challenges are frequently explained via the curse of 
dimensionality, i.e., increasing the number of dimensions leads to exponentially growing 
computational complexity. In this commentary, we argue that thinking on a different 
level helps to understand, why we face the curse of dimensionality. We introduce 
as a guiding principle the curse of instability , which triggers the classical curse of 
dimensionality. Furthermore, we claim that the curse of instability is a strong indicator 
for analytical difficulties and multiscale complexity. Finally, we suggest some practical 
conclusions for the analysis of mathematical models and formulate several conjectures. 

The classical curse of dimensionality [7J has become synonymous with the difficulty of 
analyzing large data and large mathematical models [12]. The main obstacle is that very 
few additional modelling variables may drastically increase the effective computational cost. 
A typical example is the numerical simulation of coupled interacting nonlinear dynamical 
systems. Even though a complete description of the (probability) density evolution of the 
system exists via a Liouvillc or Fokker-Planck equation [[IS], these high-dimensional partial 
differential equations are often impossible to solve, analytically or numerically. Another 
example occurs when trying to fit models to data, where increasing the dimension of the 
model, usually makes the input data very sparse psics]. However, many complex systems 
seem to defy the curse of dimensionality. Although the mathematical model has many di¬ 
mensions, its effective dimension is significantly lower [31152]. For example, many large-scale 
chemical reaction networks, such as combustion processes 03 . can frequently be reduced to 
a few effective slowly-changing dimensions after all fast reactions have occurred [80]. Many 
formally infinite-dimensional partial differential equations are effectively finite-dimensional 
(EH [73]. On the contrary, many simple-looking low-dimensional situations exhibit bewilder¬ 
ing complexity in the form of chaotic dynamics mm- A typical physical example is the 
fluid flow in a long straight pipe, which transitions to turbulence upon increasing the fluid 
velocity [13]. 

The curse of dimensionality is still viewed in many contexts as an open problem. Many 
attempts have been made to ameliorate its consequences, or even aim to remove it completely, 
in certain contexts (2E1 ®1 EH [65]. However, there is no solution, which works for all 
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situations. We are really facing a rigid scientific barrier in many cases, while it is only a 
formal or virtual barrier in others. 

Here it is proposed that thinking on a different level is required to understand, what really 
triggers or removes this barrier. Just counting ’dimensions’ or ’variables’ is insufficient. The 
true intrinsic curse we are facing is the curse of instability. In fact, we argue below that 
instabilities (a) cause an increase in dimensionality, (b) substantially raise the analytical 
difficulty, and (c) are a strong indicator for multiscale dynamical complexity. Of course, 
it turns out that (a)-(c) are intimately related. Although we shall primarily illustrate the 
concepts with examples arising in mathematics and closely-related disciplines, it will be 
shown that the abstract concept occurs, independently, across disciplines. In fact, we shall 
see that the curse of instability has already implicitly triggered the emergence of entirely new 
scientific disciplines. Furthermore, it may lead to formulate more concrete guiding principles 
to address the complexity challenges of the 21st century. 

(a) Instability causes high-dimensionality: A paradigm of mathematical modelling for 
time-dependent evolving systems is to study the evolution of an initial state uq of a system 
at time t = 0 under a mapping ut = Typical examples in this framework are 

differential equations, iterated mappings, adaptive networks, or in fact any other dynamical 
system [2Q1IZI]. Ideally, we would like u t to represent the state in a space, which is tractable 
for analytical, numerical, and modelling purposes. For example, the population density in 
a city 0 or the voltage inside a neuron [IT] are examples of scalar quantities, which are 
natural choices as variables for certain applications. However, the population density and 
the voltage inside a neuron do not evolve according to a simple universal law given by 
<F f , they are influenced by more complex multiscale systems they are embedded in, i.e., the 
global environmental system [58] and the entire brain ra respectively. Instead of taking into 
account the entire hierarchy of possible models for complex systems, one gains tremendous 
insight by restricting or truncating the influences of different levels. For example, in an 
epidemic in a city, we may just try to track susceptible or infected population densities [24]. 
In the context of a neuron one may just consider so-called channel gating variables to model 
ion channels [26]. In this philosophy, we neglect many other effects, which are in a suitable 
sense “small”, e.g., the smaller-scale network properties for epidemics [32] or channel noise 
for neurons [19]. It turns out that this approach is (unreasonably! [77]) effective because 
small perturbations to the problem formulation are frequently not visible in the final result. 

Instability implies that the previous logic is flawed. Indeed, if a system formulation or 
system state changes significantly upon small perturbations, then we have an instability. 
More formally, one can define suitable notions of Lyapunov or asymptotic stability for the 
mathematical model [25]. For example, for an asymptotically globally stable steady state 
u* we have < Ft(uo) —> u* as t —> +oo for all initial conditions uq. Classical dynamical 
systems theory states it may generically happen that such a situation can be destroyed upon 
parameter variation |TT] . Hence, parameters need to be included as slow variables in the 
model [36] . In addition, previously neglected effects in the modelling may suddenly matter 
near an instability. For example, small random imports of a pathogen into a city [TD] or 
heterogeneity along a nerve axon [33], can suddenly matter. Maybe spatial diffusion of the 
population inside the city [50] or random spikes from other neurons [60] are also relevant near 
instability? We simply cannot exclude a-priori any effects near instability. The rules what 
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is “small” have changed. Adding parameters as new variables, including spatial dimensions, 
as well as introducing stochasticity, just scratch the surface. What about heterogeneity? 
Non-locality? Coupling in networks? Microscopic scales? Time-delays? Memory of the 
system? And the list could be continued with many other effects. 

This viewpoint shows that instability is a key mechanism: a simple evolution rule fails 
and induces the need for further parametrization and/or re-evaluation of the model com¬ 
plexity. The outcome is high-dimensionality, i.e., the curse of instability triggers the curse 
of dimensionality. 

(b) Instability induces analytical difficulty: Away from instabilities, the variety of avail¬ 
able analytical and numerical techniques is very large. The general philosophy is to project, 
reduce, truncate, coarse-grain, approximate, or otherwise simplify the underlying modelling 
as well as the model equations until pen-and-paper mathematical analysis or numerical al¬ 
gorithms are feasible 0 USES 031. However, recent results in many scientific disciplines 
strongly suggest that instability is a key road-block to either apply a reduction philosophy 
or to make it hard to carry out in practice [421 661 178] . 

To illustrate the mathematical difficulty we consider two recent examples, ft is frequently 
necessary to model space-time dependent dynamical processes under the influence of external 
stochastic perturbations or to use noise to model fluctuations from microscopic scales. Al¬ 
though the space-time noise process is usually an infinite-dimensional mathematical object, 
there are many situations where it can efficiently be truncated [62], i.e., certain higher-mode 
components do not play a significant role. However, if instability comes into play, then the 
noise process can be truly infinite-dimensional and tends to effect all modes. The dramatic 
increase in mathematical difficulty is exemplified by the fact that only very recently [221ET] a 
precise mathematical meaning was attached to large classes of stochastic partial differential 
equation^]. A typical example in this class of equations is the Kardar-Parisi-Zhang (KPZ) 
[31 ] equation, which can be used as a model for certain random growth processes, such as 
burning fronts or crack formation, where the interface of the growth process is precisely 
where the (small-scale) instability occurs [69]. As a second example, one may consider the 
notion of hyperbolicity in dynamical systems. Roughly speaking, if a nonlinear system is 
hyperbolic locally, then it is locally possible to predict its behavior from a linearized version 
of the system. The overall system dynamics is stable under small nonlinear perturbations. 
However, if hyperbolicity fails then one is confronted with instability of the mathematical 
model class. Even many low-dimensional classes of non-hyperbolic dynamical systems M 
lead to formidable challenge^]. 

A huge variety of further cases could be given to illustrate the difficulty of instabilities. 
This includes theoretical as well as experimental issues, side-by-side. Some typical examples 
are: chaotic dynamics and turbulence in fluids [27, [61], microscopic instabilities and crack 
formation in materials pm], early-warning signs and drastic changes in time series [661138] . 
pattern-formation and Bose-Einstcin condensation [691 [36], feedback control models of the 
cell cycle [611 [67], heterogeneous large-scale networks and financial crises [T71 139] . The 

1 Martin Hairer received the Fields Medal, (one of) the highest honors in mathematics, in 2014 for his 
work on stochastic partial differential equations and the KPZ equation. 

2 Artur Avila received the Fields Medal, (one of) the highest honors in mathematics, in 2014 for his work 
on renormalization in classes of dynamical systems, which are not hyperbolic. 
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list could be continued to staggering length, and effectively across all scientific areas [3]. 
Whenever one looks at the underlying mathematical models formidable challenges occur 
precisely when instabilities are relevant for the dynamics. 

(c) Instability indicates multiscale complexity: Another important issue directly related 
to instabilities are hidden scales. Far away from instabilities, it is acceptable to neglect 
many effects as “small” because they occur on scales not relevant for the problem at hand. 
For example, to develop a method to forecast the temperature from today for tomorrow, 
it is perfectly safe to ignore the daily change of sea-ice. However, on longer time scales, 
the ice-albedo feedback loop [33] can lead to very drastic climate, and hence temperature, 
changes. As a spatial example, one might consider cancer. If a tumor is large, its growth 
can be described quite well by a macroscopic mean-field model on the macroscopic scale of 
the body [29], while the instability and the processes to generate the mutations can occur 
on significantly smaller cellular or even sub-cellular microscales [23] . 

The key is that near an instability, the rules of modelling also have changed. Each part 
of a process could contribute significantly. This frequently necessitates to include not only 
additional small parameters but entirely new scales for the problem. Many novel scientific 
disciplines have emerged implicitly due to the necessity for multiscale models. For example, 
network science [53i, 2\ argues that not only the local individual but also the global intercon¬ 
nected collective scale matters. In fact, instability is again at the root of this phenomenon, 
e.g., a small change in connectivity may lead to a large change in global path-length con¬ 
nectivity [751 EU- The dynamical process of adding connections is hence precisely near an 
instability when the change from local modelling to networks arises. A similar effect occurs 
for coherence or synchronization phenomena on networks, e.g., truly emergent network ef¬ 
fects often arise only upon sufficiently strong coupling [72] when each individual node leaves 
its intrinsic stable steady state. An analogous argument can be made to explain the emer¬ 
gence of systems biology [37], i.e., the need for a systemic view of biological processes only 
arises because of observed instabilities within certain subprocesses. 

So far, we have demonstrated why the curse of instability is a key factor which triggers 
high-dimensionality, analytical difficulty and the need for multiple scales. Clearly, all three 
effects are related and it is helpful to use the curse of instability to explain and relate them. 
The question remains, whether we can draw any practical consequences from this abstract 
viewpoint? 

The first step is to identify instabilities , i.e., to ask whether the process to be modeled 
does exhibit at the relevant observational scale significant qualitative or quantitative changes. 
From a statistical physics viewpoint, this will essentially always be the case for “systems 
out-of-equilibrium” HU. In most complex systems one is usually interested to precisely 
understand dynamical changes. This is a core reason, why practical applications tend to lead 
to mathematical models, which - according to (a)-(c) above - are difficult high-dimensional 
multiscale problems. 

The second conclusion is the strong necessity to dynamically simplify models. Indeed, 
from (a)-(c) it follows that building a global model, which incorporates all possible effects 
for all parameters and all couplings is impossible. Hence, models need to be designed and 
analyzed for specific phenomena and then coupled on hierarchical scales. The influence of 
smaller and larger scales have to be simplified on the current scale. For example, in climate 
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models one often introduces external forcing [54] or stochastic fluctuations [55] to model 
different scales. Of course, this strategy is practiced implicitly by many scientists every day 
but sometimes incorrectly. The point is not to focus purely on simplifying the model to 
alleviate the computational and analytical burden but one should check what dynamical 
features near instabilities are preserved or lost. 

The third important conclusion is to improve bridges between specialist tools. Near an 
instability, several effects can be of equal size, e.g., coupling, noise, and energy dissipation. 
Of course, one could try to address the mathematical analysis of this situation just with one 
particular tool, adapted to cover two additional effects. However, this is likely not to alleviate 
the difficulties. For example, a purely variational approach build upon energy-like functionals 
[63] may not easily generalize to include stochasticity [18] or coupling via complex networks 
[53]. Similarly, pure combinatorial network tools or stochastic dynamics techniques may miss 
important macroscopic energy effects. In fact, recent progress in all areas of mathematical 
theory of complex systems points into the direction of better understanding relations between 
approaches. 

In conclusion, it has been suggested to use the curse of instability as another impor¬ 
tant general scientific principle. It has been argued that it triggers the classical curse of 
dimensionality. Furthermore, it is a strong indicator for analytical difficulties and multiscale 
complexity. Although only a few practical conclusions based on this principle have been sug¬ 
gested, it is quite reasonable to assume that far-reaching additional ideas can be developed 
from the framework sketched here. For example, based on the curse of instability, one may 
make the following, quite daunting, conjectures: 

(Cl) So-called “universal” [3D] or “generic” [76] dynamical principles are always based upon 
the absence or presence of certain instability classes. 

(C2) When analyzing big data [48] one has to separate the data into regimes with and 
without instabilities in the underlying process. 

(C3) Self-organized criticality [6] and the occurrence of power laws are related because ex¬ 
ponential laws usually fail near instability. 

(C4) Control of complex systems [68] can be “localized”, i.e., using a different controller 
near each instability. 

(C5) The principle of renormalization (or the renormalization group) [79] can be applied 
successfully because it preserves the underlying stability or instability model class. 

(C6) Multiscale computational algorithms [46] are only necessary when instabilities occur. 

Of course, the conjectures (C1)-(C6) are highly speculative. However, they illustrate 
why a new guiding principle such as the curse of instability can help to pinpoint simple and 
natural guesses to complex scientific problems. 
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